Neural network input feature selection using structured l2 − norm penalization

نویسندگان

چکیده

Abstract Artificial neural networks are referred to as universal approximators due their inherent ability reconstruct complex linear and nonlinear output maps conceived input-output relationships from data sets. This can be done by reducing large via regularization in order establish compact models containing fewer parameters aimed at describing vital dependencies In situations where the sets contain non-informative input features, devising a continuous, optimal feature selection technique lead improved prediction or classification. We propose continuous through dimensional reduction mechanism using ‘structured’ l 2 − norm regularization. The implementation is identifying most informative subsets given set an adaptive training mechanism. adaptation involves introducing novel, modified gradient approach during deal with non-differentiability associated of structured penalty. When method applied process sets, results indicate that inputs artificial selected penalization.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

l2, 1-Norm Regularized Discriminative Feature Selection for Unsupervised Learning

Compared with supervised learning for feature selection, it is muchmore difficult to select the discriminative features in unsupervised learning due to the lack of label information. Traditional unsupervised feature selection algorithms usually select the features which best preserve the data distribution, e.g., manifold structure, of the whole feature set. Under the assumption that the class l...

متن کامل

Exact Top-k Feature Selection via l2, 0-Norm Constraint

In this paper, we propose a novel robust and pragmatic feature selection approach. Unlike those sparse learning based feature selection methods which tackle the approximate problem by imposing sparsity regularization in the objective function, the proposed method only has one `2,1-norm loss term with an explicit `2,0-Norm equality constraint. An efficient algorithm based on augmented Lagrangian...

متن کامل

improving short-term wind power prediction with neural network and ica algorithm and input feature selection

according to this fact that wind is now a part of global energy portfolio and due to unreliable and discontinuous production of wind energy; prediction of wind power value is proposed as a main necessity. in recent years, various methods have been proposed for wind power prediction. in this paper the prediction structure involves feature selection and use of artificial neural network (ann). in ...

متن کامل

Forecasting of rainfall using different input selection methods on climate signals for neural network inputs

Long-term prediction of precipitation in planning and managing water resources, especially in arid and semi-arid countries such as Iran, has a great importance. In this paper, a method for predicting long-term precipitation using weather signals and artificial neural networks is presented. For this purpose, climatic data (large-scale signals) and meteorological data (local precipitation and tem...

متن کامل

Bayesian Input Selection for Neural Network Classiiers 1 Bayesian Input Selection for Neural Network Classiiers

In this paper we discuss the use of the Bayesian posterior probability distribution over weight space and Receiver Operating Characteristic curves in a neural network input selection algorithm. The a posteriori distribution is obtained by combining the likelihood function based on training data and a prior distribution based on expert knowledge. To numerically calculate the marginalization, Mar...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied Intelligence

سال: 2022

ISSN: ['0924-669X', '1573-7497']

DOI: https://doi.org/10.1007/s10489-022-03539-8